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(54) Article recognition and 
handling system 

(57) A succession of articles e.g. 
casting to be fettled, presented at 
random and of random orientation is 
identified in turn and orientated to a 
predetermined configuration by a 
system which not only obtains an 
image in the form of a silhouette 
from which are derived a number of 
dimensional parameters which are 
compared in a computer with the 
stored parameters from known 
classes of article but also a weight 
parameter is included. The articles 
may be turned over from one stable 
position of repose to another for 
identification and/or for final 
positioning by pushing them over a 
stop 10 onto a adjustable height 
platform 4. 

Robot 1 1 may then remove 
correctly orientated and identified 
articles for appropriate treatment as 
required for each class of article. 
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SPECIFICATION 

Article recognition and handling system 

5 This invention relates to a system designed to 
transfer, by a series of inspections and mani- 
pulations, a random order and arrangement of 
different finished or unfinished articles of vary- 
ing shape to a state where they are each 

10 identified and in a known and predetermined 
position and orientation for subsequent auto- 
matic handling and/or treatment. 

Pattern recognition systems have been the 
subject of much discussion and development 

15 in recent years, and the general line of devel- 
opment has been in the direction of illuminat- 
ing the object to be identified and scanning it 
optically to compare it with images of known 
articles. Such a system depends on the article 

20 being of a known exact shape, and also as- 
sumes the possibility of obtaining good optical 
contrast to define clearly the outline of the 
article. The use of grey-level cameras to ob- 
tain the image, with automatic adjustment of 

25 the contrast to suit the conditions, is known 
and goes some way to deal with the second 
of these problems, but not the first. Difficul- 
ties arise when the articles to be identified in 
a defined class are expected in practice to 

30 have a significant degree of variation in shape 
yet still be acceptable despite such variations, 
provided they are, for example, variations in 
certain dimensions or profiles but not in oth- 
ers. 

35 A further limitation on most known systems 
is that they assume the articles are lying flat 
in a predetermined plane. 

One field where the problem exists of ac- 
ceptable articles having a substantial degree of 

40 variation in shape is that of identifying cast- 
ings, mouldings or forgings, on which un- 
wanted material is present, for example in the 
form of flash, feeder stubs and risers. For 
example the flash extending laterally at the 

45 parting plane may extend sufficiently far in 
various random directions to alter significantly 
the silhouette of the article when viewed in a 
direction perpendicular to that plane and in the 
known systems it could lead to the rejection 

50 of a perfectly acceptable article. This variation 
of physical parameters can cause confusion 
and wrong decisions. Yet there is a need in 
particular to be able to identify the handle 
such articles reliably, for example, in equip- 

55 ment for feeding them to a subsequent fettl- 
ing, flash-removal or other finishing process. 

At the same time, in the case of castings, 
there is a need to reject reliably mis-run cast- 
ings, castings with no cord cavity, or compo- 

60 nents with so much excess material that they 
would be difficult to manipulate in the subse- 
quent operations, or even might damage the 
tools used in such treatment. 

The aim of this invention is therefore to 

65 provide a way of identifying articles by type 
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on the basis of particular articles of ideal form 
and despite some degree of variation in the 
observable parameters, so that it should not 
be wrongly rejected as deficient when the var- 
70 iation is in a parameter that is not vital to the 
essential character or quality of the article, 
and also a way of then positioning and orien- 
tating the object into a predetermined known 
attitude for further handling or treatment. 
75 A further aim is to provide such a system 
which is at the same time sufficiently flexible 
to be adapted as required to handle entirely 
new classes of articles, i.e. to be 'taught' 
fresh recognition skills. 
80 According to the invention we now propose 
a system for identifying and positioning differ- 
ent articles fed to it at random comprising a 
pattern recognition system involving an illumi- 
nation system using radiation which is not 
85 necessarily visible light indeed not necessarily 
electromagnetic and a profile or silhouette de- 
tector, in combination with a computer to 
which signals representing the weight as well 
the profile parameters are fed, the computer 
90 being arranged to select the minimum number 
of such parameter signals that is found to be 
necessary to identify reliably the class to 
which the article belongs, with means for re- 
jecting those not so identified and means for 
95 turning to a predetermined attitude those 
which are accepted. 

The system involves means for re-position- 
ing the article where it is not identified first 
time around and according to a further feature 

100 of the invention the re-positioning means may 
include a step device that causes the article to 
be tilted to a fresh stable position under its 
own weight, possibly two or three times. 
Preferably the article is also weighed and 

105 the weight forms one of the parameters fed 
to the computer. 

The articles which are recognised are 
passed to the re-positioning means where 
their orientation is adjusted by rotation, hori- 

110 zontal displacement, and possibly tilting to a 
new stable rest position by the step device 
mentioned above. The step can be of adjust- 
able height, its height being set in accordance 
with the article identified, and attitude which it 

115 is then occupying. 

The article can be returned to the recogni- 
tion or identifying means after each mechani- 
cal operation or series of operations to be re- 
checked only up to a certain specified maxi- 

120 mum number of returns, and is rejected alto- 
gether if it has not achieved the correct posi- 
tion for subsequent pick-up or final adjustment 
within this predetermined number of move- 
ments. The article may then be acted upon by 

125 final positioning or pick-up means at which 

point it is in exactly the required configuration 
from which the computer may initiate a further 
sequence of treatment or handling, such as, 
fettling, machining, painting, welding, as- 

130 sembly, inspection or any other process. This 
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is in contrast to some known systems, in 
which the recognition system, having identified 
this article, then has to instruct a robot or 
other handling device how to pick it up from 
5 the random position in which it has been iden- 
tified as lying, and the recognition system is 
therefore in practice only usable with a parti- 
cular associated robot system. 
Furthermore, because the computer has 

10 identified the article, it is able to initiate those 
further operations in the appropriate manner, 
i.e. to instruct a robot or machining system to 
select the appropriate stored program, starting 
with selecting the appropriate movements for 

15a gripper or other transfer system for picking 
the article up from the position into which it 
has been brought by the system which is the 
subject of the invention, and removing it for 
the further handling. 

20 The identification or recognition of the arti- 
cle is achieved by comparison with a predeter- 
mined set of reference parameters, including 
the weight, and these are evaluated from ac- 
ceptable articles and 'taught' to the control 

25 means. The number of parameters used, 
which, besides the weight could include the 
area of the silhouette, its perimeter and oth- 
ers, are selected to be the minimum neces- 
sary to identify the article unambiguously as 

30 belonging to a particular class. 

It is also important that the system should, 
by the parameters used, be able to distinguish 
uniquely all the stable positions of each article 
taught, including its angle of rotation when 

35 placed in the viewing position, and be able, 
with a high degree of reliability, to reject arti- 
cles not recognised. The necessary para- 
meters may be selected entirely by the com- 
puter or may be wholly or partially selected 

40 manually on the basis of previous operating 
experience with the articles to be recognised. 
This number is found by the computer taking 
a large selection of parameters during its 
'teach' mode and eliminating those which are 

45 not necessary for a definite identification; the 
remainder are then those chosen to be em- 
ployed during operation of the system. 

This method allows further classes of arti- 
cles to be accommodated easily, and the vari- 

50 ation in the amount of unwanted material, e.g. 
in the form of flash on cast, forged or 
moulded articles, which is permissible is also 
determined on articles which have material to 
an acceptable degree. There could be a man- 

55 ual override to alter the acceptable limits of 
variation of a given parameter if desired; each 
article has this evaluation of parameters and 
acceptable limits of variation for every stable 
position of repose. 

60 The invention will now be further described 
by way of example with reference to the ac- 
companying drawings, which illustrate a sys- 
tem according to the invention in purely dia- 
grammatic terms, and in which: — 

65 Figure 7 is a side elevation of the system, 



and 

Figure 2 is an outline which is of assistance 
in understanding the principles by which an 
article is identified. 
70 There is shown at 1 a belt conveyor carry- 
ing a succession of articles of different 
classes and furthermore articles of a given 
class will be in different orientations, not only 
facing in different directions in the horizontal 
75 plane but also lying in different attitudes, for . 
example some on their faces and some on 
their backs or sides. They may, by way of 
example, be castings emerging from the 
knock-out station of a foundry and needing 
80 now to be fettled; they may or may not still 
have feeder stubs, but will certainly have 
some degree of flash, in a form which varies 
in a random manner. 
The purpose of the system according to the 
85 invention is to identify those articles and then 
turn them to a predetermined attitude and ori- 
entation for subsequent handling, whilst reject- 
ing articles which are outside acceptable lim- 
its, or faulty, or which should not be on the 
90 conveyor at all. 

First the articles are spaced out on the conr- 
veyor 1 so that there are in line with an inter- 
val between each adjacent pair, this is a 
known technique and need not be described. 
95 The conveyor feeds the castings singly on de- 
mand onto a weighing table 2 supported on 
load cells (not shown) to produce an electrical 
weight signal. A photo-cell (not shown) de- 
tects the casting as it falls off the conveyor 

100 onto the table and automatically stops the 
conveyor. To avoid damage to the delicate 
weighing equipment by the impact of the cast- 
ing on the table, the table is temporarily auto- 
matically raised off the weighing equipment by 

105 inflatable flexible tubes or bags (not shown) 
when the conveyor is running and then the 
tubes are deflated when the conveyor stops. 

Lying over the weighing table 2 is an open 
rectangular frame 3 which carries means for 

110 centralising the casting comprising pairs of 
bars (not shown) which move in from oppo- 
site sides and push the casting, regardless of 
its shape, size, and attitude, to the centre of 
the table. The frame is, after the weighing 

115 operation, translated horizontally, moving the 
casting with it, across a platform 4, to be 
referred to later, onto the identification table, 
shown at 5. This table 5 is translucent and is 
illuminated from below by a source 6. Further- 

120 more it is rotatable about a central vertical 
axis with a fine degree of precision under the 
control of a computer 7. 

Above the table 5 is a digital camera 8 
which receives a silhouette image of the cast- 

125 ing lying centrally on the table (the centralising 
bars in the frame 3 having been retracted in 
the meantime). 

The source 6 need not be of visible light 
but on the contrary could use a form of radia- 

130 tion less liable to be affected by the presence 



BNSDOCID:<GB 2167211 A l> 



GB2167211A 



of dirt on the table 5 or in the atmosphere, 
for example infra-red or ultra-violet light. 

The signal produced by the camera 8 is at a 
single level in binary form, as opposed to a 
5 grey-level picture. The digital information 70 
which this represents is fed to the computer 7 
and compared with that stored from the ear- 
lier 'teaching' of the computer by means of 
standard articles. This teaching will be de- 

10 scribed in a little more detail below. The sig- 75 
nal from the weighing table 2 is also fed to 
the computer. 

The system could, within the scope of the 
invention, include a second illuminating source 

15 and screen, for example looking horizontally, 80 
or even a mechanical feeler to sense the atti- 
tude, orientation or position of the component 
in the unlikely event that one device does not 
discriminate absolutely. 

20 The computer 7 determines whether the in- 85 
formation on the weight and shape indicates 
that the article falls within one of the classes 
it recognises. As explained above, with arti- 
cles like castings they may, dependent on 

25 their shape, be capable of arriving at the table 90 
in any one of three or even more different 
possible attitudes, each of them a stable posi- 
tion in which it may happen to lie. The com- 
puter has recorded In its memory, parameters 

30 of each article in every one of its possible 95 
stable positions of repose; the means of ac- 
quiring such information will be discussed later 
below. 

If the computer fails to recognise the article 

35 as falling within any of the classes it has been 100 
programmed to accept, then the article is re- 
jected. This can be done in various ways; in 
the example illustrated the frame 3 is lifted 
and a ram (not shown) pushes the rejected 

40 article down a chute 9. Those articles which 105 
are rejected can be inspected visually at lei- 
sure to determine whether they are fundamen- 
tally faulty or capable of reclamation. 

The weight test is a valuable one, particu- 

45 larly in the case of unfinished metal castings. 110 
A lower limit can be determined closely for a 
given casting, representing the article with vir- 
tually no flash; if it is below that, then, as- 
suming the casting has been identified through 

50 the other parameters as being of a certain 115 
class, it must be a mis-run. The upper limit on 
weight is determined by the maximum accept- 
able amount of flash. Over this indicates that 
there is more flash than the subsequent treat- 

55 ment can satisfactorily remove, or that there 1 20 
was a core missing in the mould in which it 
was cast. 

Articles which are recognised have to be re- 
orientated and/or turned over until they are in 

60 the configuration recognised by the computer 125 
7 as correct for the subsequent handling and 
treatment. Re-orientation in the horizontal 
plane is easily achieved by rotation of the ta- 
ble 5. To turn the article over into a different 

65 stable position of repose we make use of a 130 



step, indicated at 10 in Fig. 1. For example, if 
the computer has ascertained that the article 
is on its side and needs to be tipped onto its 
base it is rotated on the table 5 until its base 
is towards the step 10. Then the height of 
the platform 4 mentioned earlier, beyond and 
below the level of the step 10, is adjusted to 
suit the particular tilting operation to be per- 
formed, knowing the class of article and its 
orientation. The frame 3 then moves to carry 
the article over the step, so that it falls onto 
its base on the platform 4, which then rises 
to lie flush with the step 10, whereupon the 
frame 3 moves the article, now standing on 
its base, back onto the table 5. 

This tipping operation can, if necessary be 
repeated more than once to get the article the 
required way up; it is then turned to the final 
required orientation. A final check by means 
of the digital camera 8 ensures that the atti- 
tude and orientation are correct, and then the 
computer can signal that the job of the recog- 
nition system is complete, and at the same 
time it informs the equipment controlling the 
further treatment what class of article is pre- 
sent. This allows, for example a robot 1 1 that 
forms part of that equipment to pick up the 
article from the table in the correct way and 
carry it away for that further treatment, for 
example by hodling it for engagement by fettl- 
ing grinders. Those grinders will have been 
programmed in a known manner to engage 
the article in the appropriate manner, knowing 
the class of article and the areas in which 
flash is to be expected. 

A limit is placed on the number of manipula- 
tions of position or times which an article may 
be turned over before the component may be 
accepted, this limit being the maximum num- 
ber of operations needed to get a component 
of the type originally identified by the com- 
puter from any stable position to the required 
stable position, and this number can vary with 
category of article. It is necessary to remove 
those articles which are likely to damage the 
tools, machinery or equipment used in subse- 
quent stages of processing, testing or manu- 
facture by virtue of there being too much un- 
wanted material on unfinished articles or by 
the deformed nature of the article itself. 

In a modification of the system described 
the weighing step could be incorporated in the 
table 5, eliminating the need for the separate 
weighing table 2. 

We shall now go into more detail about 
how the computer 7 identifies the class of 
article from a minimum number of measured 
parameters. 

The computer needs to be informed of the 
various categories of article which it is re- 
quired to identify and position and is equipped 
with a 'teach' mode in which this may be 
accomplished. A particular article is positioned 
such that the camera may view its silhouette 
and feed information to the computer, this be- 
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ing done fop every stable position of repose 
of the articfe. To allow for variations in shape 
of unfinished articles due to flash or other ex- 
cess material which may later be removed the 
5 computer also has presented to it, in all allow- 
able configurations, articles with unwanted 
material present within limits deemed to be 
acceptable for subsequent operations and a 
record of the limits of variations of parameters 
10 is made. 

In a typical case of a teaching operation a 
sample of the article is placed on the table 5 
and its image analysed in each of twelve dif- 
ferent angular positions. The minimum values 
1 5 of certain significant dimensions are recorded. 
This is repeated for each of several samples 
of the same class of article and a picture is 
built up of the maximum and minimum values 
to be expected for each of those dimensions. 
20 Provided the samples are representative of the 
range of acceptable articles within the class, 
the maximum and minimum will then cover all 
the articles which are to be recognised as 
such. For example in the case of castings 
25 some may have very little flash and some may 
have a lot, some may have flash in one area 
and some in another. If necessary a manual 
entry may be made to expand the upper or 
lower limit of certain dimensions to deal with 
30 particular situations. 

The teaching process must be repeated for 
each of the three or more possible positions 
of response in which the article is capable of 
lying on the table 5. 
35 It is important to appreciate that, for the 
recognition step, the computer 7 does not 
simply look at the image presented to the 
camera and compare that with a large number 
of stored images; to do that would require a 
40 very large amount of memory to hold the 

enormous number of images, each of the arti- 
cle in a slight different orientation. Moreover 
the comparison step would take an unaccepta- 
bly long time. A further problem is that a 
45 casting with an appreciable amount of flash in 
certain areas might find itself unjustifiably re- 
jected by such a straight comparison method. 

Instead the computer derives from the di- 
mensions and other features of the image cer- 
50 tain parameters and it is possible to ascertain 
that, provided the right selection of para- 
meters is made, the combination of them is 
unique to the given class of article. For 
example it is relatively easy to derive the 
55 parameter and area of the image and the num- 
ber of holes in it. 

We refer to Fig. 3 which shows a simple 
outline such as might form the silhouette ob- 
served by the camera 5. 
60 In the 'teach' mode the computer may re- 
cord parameters such as: 
Weight (an important feature of the invention) 

1 . Number of holes. 

2. Area. 

65 3. Perimeter lenght a) including holes 



b) excluding holes 

4. Shape factor (=square of perimeter area) 
For the following measurements the centre 

of gravity of the area (point A) and the centre 
70 of gravity of the perimeter (point B) are calcu- 
lated. The centre of gravity of the perimeter 
excluding holes (point C) can also be calcu- 
lated. 

5. Maximum length to perimeter from point 
75 A. 

6. Minimum length to perimeter from point 
A. 

7. Maximum length to perimeter from point 

B: 

80 8. Minimum length to perimeter from point 
B. 

9. First moment of area about point A. 

10. Second moment of area about point A. 

1 1 . First moment of perimeter about point- 

85 B. 

12. Second moment of perimeter about po- 
int B. 

13. Minimum length to perimeter excluding 
holes from point A. 

90 14. Minimum length to perimeter excluding 
holes from point B. 

15. Maximum length to perimeter from point 

C. 

16. Minimum length to perimeter including 
95 holes, from point C. 

17. Minimum length to perimeter, excluding 
holes, from point C. 

The above dimensions require the identifica- 
tion of four points on an article with no holes 

100 and nine points an article containing holes 
when viewed in silhouette. Maximum dimen- 
sions can also be measured from these points 
instead of the point defined above to give a 
further possible maximum nine dimensions to 

105 give a total of 21 readings. 

If the article contains holes when viewed in 
silhouette, the area, perimeter, shape factor, 
maximum and minimum length and the first 
and second moments of the hole area and 

110 perimeter can also be calculated. If ail the 

holes are dealt with as one feature this would 
produce a further eleven readings giving a to- 
tal of 32 possible measurements. For an arti- 
cle with a hole, the hole itself can be treated 

115 as a silhouette and parameters measured on 
just this hole. 

Also the facility for measuring the angle be- 
tween any two lines defined on the article by 
the maximum or minimum readings may be 

120 included. Even on a simple article without 
holes this gives a total of six angles that 
could be determined. 

Clearly to measure all the angles and para- 
meters that could be measured is impractical 

125 and unnecesary. Preferably the angle between 
the maximum and minimum dimensions de- 
tected on the perimeter — including any holes 
present — from the centre of gravity could be 
measured in addition to some other limiting 

130 measurement or measurements. 
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From this large amount of information the 
computer is instructed to select the minimum 
number of parameters necessary to identify 
each article positively, and this may vary from 
5 article to article. An important feature is the 
inclusion of fail-safe selection procedures for 
the parameters to ensure that no two articles 
have recognition parameters including coeffici- 
ents or variation which take into account vari- 
10 ations in shape of unfinished articles which 
could possibly result in one article being incor- 
rectly identified as another. These selected 
parameters are then the only ones calculated 
by the computer when it inspects an article, 
15 the weight being a decisive limiting parameter 
in each case. 

Complete finished articles may be presented 
as ideals to the recognition system to identify 
the lower limits of excess metal and weight. 
20 Manual instruction may also be given. 

If required rejected articles may be reposi- 
tioned and reintroduced for the purpose of re- 
cognition. 

The final orientation of a component for po- 

25 sitioning ready to be picked up for subsequent 
treatment could be measured by measuring 
the angle between a specified line of the sys- 
tem, for example line A to B and line A to the 
minimum dimension, or if the component has 

30 a hole, from the centre of gravity of the hole 
to the centre of gravity of the whole sil- 
houette provides another useful line. 

The essence of the invention may be sum- 
marised as recognition means capable of iden- 

35 tifying each of a number of different kinds of 
article which may be unfinished and of varying 
shape and using its recognition to re-orientate 
and re-position and to turn over an object so 
that it lies at a precisely known position and 

40 at a known orientation, the method of recog- 
nition being by a combination of silhouette 
parameters which are compared with para- 
meters already learnt by the computer to be 
acceptable for a particular category of article, 

45 and the parameters preferably include the 
weight of the article. 

As compared with known systems the in- 
vention includes a weight and silhouette in- 
specting device as means of examining an ar- 

50 ticie to determine whether or not the article 
lies within an acceptable range of variation for 
any particular class of article. The system is 
capable of identifying an article as belonging 
to a category or class despite significant varia- 

55 tions in the parameters it has to monitor. 

CLAIMS 

1. A system for identifying and orientating 
articles presented to it at random in succes- 

60 sion comprising means for illuminating the arti- 
cle to present an image, from which a number 
of dimensional parameters are obtained, these 
paramters, being analysed in a computer and 
compared with the figures for known classes 

65 of articles, and including means for tilting the 



article to different configurations if necessary 
and finally means, controlled by the computer, 
for presenting the article in a predetermined 
configuration and orientation for subsequent 

70 handling. 

2. A system according to claim 1 including 
means for weighing the article to produce a 
weight parameter which is included in the said 
analysis of parameters. 

75 3. A system according to claim 1 or claim 
2 in which the illuminating means comprise an 
infra-red or ultra-violet source. 

4. A system according to any one of 
claims 1 to 3 in which the image is obtained 

80 by a digital camera. 

5. A system according to claim 4 including 
means for centralising the article into a predet- 
ermined position in a field of view before the 
image is obtained by the camera. 

85 6. A system according to any one of 

claims 1 to 5 in which the orientating means 
include a table which is rotatable about a cen- 
tral vertical axis. 

7. A system according to claim 6 in which 
90 the illuminating means illuminate the article 

from below while it is on the table and the 
image is formed above the article. 

8. A system according to claim 6 or claim 
7 as dependent upon claim 2 in which the 

95 means by which the weight parameter is ob- 
tained is incorporated in the table. 

9. A system according to any one of 
claims 1 to 8 in which the tilting means com- 
prise a step of adjustable height over which 

100 the article is pushed, so as to fall by gravity 
into a new configuration. 

10. A system according to claim 9 includ- 
ing means for setting the height of the step in 
accordance with the class of article and its 

105 configuration at the time. 

11. A system according to any one of 
claims 1 to 10 in which the dimensional para- 
meters by which the article is recognised in- 
clude the area of the silhouette, its perimeter, 

110 the presence of any holes, and the relative 
positions of the centres of its area and its 
perimeter. 

12. A system according to claim 1 1 in 
which the dimensional parameters by which 

1 1 5 the article is recognised include the minimum 
and/or maximum lengths from one or more of 
the said centres to its perimeter. 

13. A system according to claim 1 1 or 
claim 12 in which the dimensional parameters 

120 by which the article is recognised include the 
first and/or second moments of area about 
one or more of the said centres. 

14. A system for identifying and orientat- 
ing articles presented to it at random in suc- 

125 cession, substantially as described with refer- 
ence to the accompanying drawings. 
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